Examining the reliability and predictive validity of performance assessments by soccer coaches and scouts: The influence of structured collection and mechanical combination of information

Soccer coaches and scouts typically assess in-game soccer performance to predict players’ future performance. However, there is hardly any research on the reliability predictive validity of coaches’ scouts’ assessments, or strategies they can use optimize their predictions. In current study, we examined whether robust principles from psychological selection – namely structured information collection mechanical combination predictor through a decision-rule improve assessments. A total n = 96 participated in an elaborate within-subjects experiment. Participants watched video, rated both unstructured manner, combined ratings holistic way. We inter-rater assessed by relating market values. Contrary our expectations, did not find that based assessment paired with showed higher validity. contrast, unstructured-holistic yielded highest validity, although differences were marginal. Overall, was poor validities small-to-moderate, regardless approach used rate The findings provide insights into difficulty predicting soccer.